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While the values derived from institutional 
■--^If-^valuat^ on efforts are fairly well understood, external 
-valuation is an important process in aiding an institution m the 
achievement of its goals; it supplements and complements, but does 
not supplant s el f- e va lua t i on. Common functions of the external 
-valuation component of the Advanced Institutional Development (AID) 
OT-oqram include: (1) determining the extent to which the college has 
d^v^loped a continuing internal evaluation system, encompassing its 
total oD^rations and internal constituencies; (2) examining 
r-la^ionshiDS between institutional goals, mission, and AID Program 
^ctiv^-ty objectives; and (3) determination of adequacy of procedures 
and processes esTDloyed tor periodic re-examination of goals ana 
mission, effectiveness assessment, commijnication of evaluation _ 
irforraation, and use of evaluation infojmation in planning. It is no. 
P function of external evaluation to r nder judgements about the 
auality or substance of the institution's goals or mission or to 

opinions or funding or non-funding of specific activities. The 
ox^'ernal evaluator's qualifications should include: familiarity with 
-he f.ID Prog-am, ATP iconi+oring and evaluation concepts, forms, and 
proces-^-^- access to varying expertise needed to evaluate outcomes of 
-he 'institution' s activities; and a background in higher education 
evaluation. (Author/ JDS) 
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THE FUNCTION OF EXTERNAL EVALUATION 
IN THE AID PROGRAM 



Evaluation toncis lo produce tlie most fruitful bonefits wfien those directly involved 
in thci development and implementation of goal-oriented effort are at the same time involved 
in moaningful fashion in the evaluation of those efforts. It is through this type of involve- 
ment that goals and objeciives become more clearly understood and more completely inter- 
nalized; and, as a result, tiiey serve to sustain and direct efforts more effectively and effi- 
ciently toward the achievement of desired ends. Thus, as institutions undertake self-improve- 
ment, self-evaluation is of especial importance. 

The values derived from self-evaluation efforts are fairly well understood. Self-evalua- 
tion procedures are used by colleges and universities in preparation for academic accreditation 
visits, in preparing to launch fund-raising campaigns, in assessing impacts of academic pro- 
grams and in many other ways r>iOt always, but quite commonly, self-evaluation projects 
are pursued on an ad hoc basis without continuity. Periodic checks by an external evaluator 
may aid in stimulating evaluation on a more continuous basis. There are reasons to believe 
that reviews conducted by qualified evaluators from outside the institution provide added 
assurances of objective analysis and a fresh look at levels of performance. One unique element 
in the AlD Program is the suggested provision for an external group of evaluators to advise 
tfie chief executive of an institution on a periodic basis concerning progress toward objective 
attainment and to assess the quality of the internal evaluation process for determining pro^ 
gress of program activities. This report deals with the role and functions of the external 
evaluation services which may be provided for in the AID Program. The report is intended 
to assist college and univefsiiy management in planning for effective utilization of these 
external evaluation services. 



SIGNIFICANCE OF 

EXTERNAL EVALUATION 

Each institution is encouraged to provide for an external evaluation, i.e., an evalua- 
tion by persons not employed at the college. External evaluation supplements and com- 
plements, but does not supplant institutional self-evaluation. It is through a combination 
of appraisal and evidence based on hard data regarding performance outcomes that out- 
side objective reviewers of the AID Program can assess progress of a program and its im- 
pact on an institution. External evaluators can bring to the institution a broadened per- 
spective based on their knowledge of higher education institutions in general and of spe- 
cialized prcvjrams in particular. They also bring perceptions [;ee from the emotional at- 
tachments and vested interests of persons who are close to the academic and/or adminis- 
trative programs. 



Lxt'M iKil inMlLKiliofi is [UM itxlic: iiiuJ providtJS d stiupshot ot tfie sttitus ot conditions dl 
{)oi[its in tinu'. To Uv. of ijciMtiiSt v;iIul\ (jeriodic L'xtorfuil (JVcilueilioo nuist bi? iin 
inlL'ijral \)'\\[ ol .1 t:oiUirujouii, oncioini) (?VciliKition tifforl nii)int;jinod Ijy tfu? institution. It 
yiiould Mfovidt; ri?linl)lo inforfnation as to tf)L' of fc?ctiven(^ss of c'lctivities desiyn(?(j lo acfiMiv<? 
sf)t?cifi(: ohjoctivos and to acconif)lish ijoals tfiat aru consonant with the institution's mission. 
While adecjuatu intornal formativo evaluation can (jonerate the same information, external 
(^valuation [)rovid(JS an ol)iec:tive validity check of a summative character periodically and 
may f:irovide guidance rekitiruj to the adecjuacy of the former. It is through a stories ol cUuir 
and accurate snaf>shots tliat ()ro(jress or lack of h, can t)e tracked. 

An important role of the external evaluator is to assess the institution's internal evalua- 
unn system, determine tfio decjrcc to which an evaluation system exists by exarninincj its 
structure and form, the ()rocesses and procedures utilized, and the nature and flow of infor- 
mation from the activity and program levels to higher levels of management and to the gov- 
erning board. A logical extension of the external evaluator's responsibility is to act in an 
ridvisory role in developing and implementing improved internal evaluation procedures. This 
also includes examining the processes and procedures by which information from the evalua- 
tion system is used for policy formulation, planning, and administration/management pur- 
(X)ses by the institution. In this regard, the external evaluation transcends the actions taken 
in relation to the supported AIDP activities and encompasses effective use of information in 
overall institutional planning, management, and evaluation. 



C OMMON FUNCTIONS or- I HL AID 

PROGRAM IiXTFiRNAL EVALUATION 

The importance of external evaluation in a national program such as AIDP has been 
clearly recognized by the U.S. Office of Education. However, the functions to be carried out 
l:iy external evaluators vary from one institution to another. The variations reflect local 
conditions such as size of the institution, previous experience of staff and their sophistica- 
tion in the development and application of evaluative techniques, the nature of funded acti- 
vities, administrative style, institutional utilization of assisting agencies and capability for 
collecting and processing information. In adapting or extracting, from the role of external 
evaluation as it applies to the institution as a whole, that which is applicable in a specialized 
sense to AID Program activities, all external evaluation efforts should include certain common 
functions, iome of these common functions will concern the institution as a whole, but 
others will focus specifically on activities funded under the AID Program. These functions 
are as follows: 

Determine the exter}t to which the institution has developed a continuing 
internal evaluation system vi'hfch encompasses its total operation, involving 
students, faculty, non-professional staff, managers, administrators, and 
governing bodies. 

■ Examine the relationships between: 

'3 Institutional goals and institutional mission; 
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Institutional (H)jIs jml All.) f^/oi/riin} jcfivity ()l)/(H:tivt}s; i)r)(I 

.1 Actii^ity ()iyo(:(iv(*s jnil ( J I tho niiHirt} of siwcific (]Luu)titJtivc ntKl (]LU}HU}tiv(} 
{k'rfi)rn)i}nci} nwnsnrcs {fosignrd to (ioU}rniif)t} achiovofrwnt of cad) objoctivtK 
and (2) nwthods for judging tluj officioncy andoffoctivcnoss wiif) which 
tMch activity is luring conduciod. 

m lJ(*t(*nnin(> the mltHjoacy nf p/oct.u/urcs and processes onipluycd for: 

.! Periodic rc-t^xaniination of institotiofial fnission and goals; 

Assessing effectiveness of AID Progran) activity acco/nplishrnent and 
institutional goal acco tnplishn lei 1 1: 

Cornniunicating evaluation infornjation to all levels of institutional ofjcra- 
tions; and 

I Using evaluatiofi information if) f)lanning to redefine objectives and to 
redirect activities if necessary. 

Review progress of all funded A ID Program activities, including those being 
implemented with the lielp of assisting agencies. 

«» Advise the institution regarding ways in wf)ich it can strengthen its AID Program 
af)d the evaluation process l)ased upon information obtained about it. 

Identify problems which may be seen emerging and give assistance as to re- 
solving them if requested to do so. 

Though many functions are common in all external evaluations, the mode of attack, 
strategies employed, and procedures implemented in the evaluation will vary. In carrying 
out these functions an examination will be made of the kinds of quantitative and qualita- 
tive data being sought for evaluative purposes and provisions for their analysis, interpretation 
and dissemination. As previously stated, external evaluators perform a wide variety of 
sf^ecif ic services for individual institutions. In addition, it is within the province of the ex- 
ternal evaluators' function to identify weaknesses in the impact measures developed to measure 
change attributable to AIDP-funded activities and in methods for assessing the effectiveness 
of the Planning, Management and Evaluation (PME) system, tf invited to do so, the evaluator 
may work with staff to overcome these weaknesses. 



CONSTRAINTS ON THE 

EXTERNAL EVALUATION 

Two constraints on the external evaluation service are noteworthy. First, it is not a 
function of the external evaluation service to render judgements about the quality and 
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suh:;t,iii(:<* ol llu^ iiist i liil ion's mission, (jodls, AI[)P jctiviliiis .iiul of)jiJ(:l ivus oi to lustily 
Of cissi?ss (iii.ililv of t)(MU»i\il .icarhMiiic or profussioiu)! proqi anis \o\ coinplianci? with jccmmI 
ilation OI state livaMisiiie and (an tiiication stanciai (is. 

Si'coiully, It is not a lunclion of tlu! (jxttaaial ejvalualion s(Mvi(:(j to mmkIim opinions 
on wholhcr oi not an activity siiould or should not fiavo Ixmmi lunde?(] l)y USOf:. fUJspiHM 
foi thi)S(? constraifUs is (?ss«Mitial to tin? rlfuctivonoss of (jxternal (jvaluation st.'rvices. 



MAJOR rmUISTS OI 

1 \ I I KNAI. I A AI liAIION 

Tin? fTKijor thrusts ol A!(3P external ovaluation are to dutormino tho extent to wfiich 
th(! institution has acconiplishf:d its AIDP objectiver, and to develop or stren(]th(?n thfj \\\ 
stiiution's capability to systematically assess [Koqress as a basis for improving program op 
erations and for further planning. Given these thrusts, the methods and strategies to be used 
in the external evaluation process include: 

Keeping the president apprised of 'h'onran: progress; 
Periodic reviews '.)f AIDP progress: 

Assistance in the interpretation and use /S( .F'AIDP Monitoring and 
Ewalnation "Schedules'' whore such help is requested; and 

» Af)nual (or more o hen, if desired) written r(.;)or. s on program progress, 
procedures, and recommendations. 

RI C 0M\1I:NI)i:i) PRO(;i-SS 

Substantativc leadership needed to carry out the functions and to accomplish the 
above purposes requires that the following factors should be observed: 

/. Because {he external evaluation contrac/m is employed by flic institution and not 
(he Office of Education, the external evaluation contractor report, the chief ex- 
ecutive of the institution and not to USOF. Information generated by external eval- 
uation activities is confidential in the sense that the chief executive, through the 
institution's mechanisms, interprets and distributes information in the report. Too, 
the external evaluation team members must be cautioned to honor the line of com- 
munications. The institution may submit copies in whole or in part or its own 
summary based on the external evaluation report to USOE or to anyor.-^ else, 
but this decision is left entirely to the college or university administration. 
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}l\c ni/ffitn'r m/ oh site visits aunltictCii hv (he cMcnutl cviihuKnr varit's (irco/difiv: 
ii> the kinds (// services a\*iecd upon (he (\s'o parties. Visits in.iy l)r oi Ir-;-, 

tft'iliKMU, (i(»()^'iKlifU} upon suit)(!:; of dcvelop'ndnt. I-(M i'xjiiiph?, duf iin) Uir tiist ye.w , 
innrr jilKMitinn ni.iy r(H|iiire(l in f (?vi(jwi(i() ol)ii,H:tivifs or [)i'rlorfnanc:(? rnrjsunjs lluio 
in sul)!i(MiULMU yiMis. The (uiniinuin nufnlifM' ol on siKj visit;; Ijy lh(j ifistilotion's (?xli?rn;il 
t'v.ilujl(;r<; sfioukl be. stMni .'innually iMcfi yiinr of tfio AIDP (jriinl poriad. For C(M Uiin 
inslilulions, (;ucirtt?rly s\U) visits may \n) ()r(M(?rro(l to {?nsiir(i continuity itnd to incriMSi^ 
t)p()ortunit.y to provid(? t(;c:finicnl iissisicincii in ovciluation [)roc(Klurtfs. (Thii frtxjijoncy 
of visits should not he. so nunujrons tfuit t:h(? (.'xtornal (^vjluntor Ix.'cornus so intiiniiKfly 
involvifd in [)roiiH:t impl^JfTiontdtion ds to i(K)|,)£ir(iize th(j hofxxi-for ul)it'ctivity J 

!'() en ha nee pliiz/nini: l<n- (he evaludtinn visit, dates for the visits should he set at the 
hei:in/iin\i of eneh sehool year. The dur-iiion of (Jiich s't(' visit will vnry h^istjd on tin* 
.iqjMul.i cind Ihi' Loniposition of the t?xtiM'nal tivnliKition toarn. Two dnys on campus 
IS ()tMHM,illy t:onsid<M(?(j ci niininnini, Init it is c)[)tionnl. Thr sch(fdu lincj of visits dm in() 

yiMT n't|uin?s cofisidiir atton so tliat visits will be. in tandcni with individuiil work 
sclic'duh?s and [nirnmi/fi th() timo spent in special pn^parations. For exanipk\ for some 
institutKMis th(» (?xte;rnal ev<iluation visits will l)e more' useful whtMi conducted a week 
or two [)rior to meetinc] some ottier deadline, such as USOE/AIDP report sulimissions. 
For other insiilutions, tlie visits will he more hfHpful if field soon after sulimittini) 
a USOE AIDP r^'iKorl. 

///(• fffrffi and freipieney of reftortin.n is itnportant (o the institution l)ein\^ evahiated. 
As soon as [lossibie fnHovvinij each evaluation visit, th(? external evaluation contractor 
^.tiouUl sutmiit a written report to the chief executive on [)ro()ress of tlie AID Program 
witfi such recommendations as are appropriate'. 

I he eoffiposition of the external evaluation team is an important nmsideration. Tiie 
nutTibor comprising a suitable team cannot he prescribed; however, it is reasonable 
to expect hi(jh quality performance from a team of three or four. Normally the "one-man" 
team is so limited in breadtti that it is difficult to imagine that an institution would 
be s(>rved even at a minimal level. 

.) [)erform effectively, the external evnluator's qual i fications should include: 

F.jmiharizatton with the AID Program, inciud/n<j Planning, Management, 
and Evaluation (PMEI and Transactional Information Systems (TIS) areas; 

Familiarization with AIDP monitoring and evaluation coficcpts, forms, 
and process; 

Access to varying expertise needed to evaluate outcomes for each of the 
institution s AIDP activities, and 

A background of experience and or education in higher education insti- 
tutions such that there is knowledge about and understanding of the type 
of uistitution for which external evaluation is to be performed, 
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In nnj(>f til .ivohl ( iMilhci ul iiilcir'.t mi p»'< |j I i i u| t ! w r v.i li i.i !( m ( ' 1 1 1'C 1 1 vr i ic/,, hr 
■Jir -.hniil) j (u il he iiivdlv/rH in i vm<l ni) ( .uiy | Ml t i)l tin' m\l 1 1 iil m m i AIM I'l .km 
,M!firf .IS .1(1 .iSM'.liiK) .nicnrv 'H 'Hi .irlivil\ .inM roiiMill.iiil . 

In M imiDji V, ♦'^ tiM rv.ilu.il lu'i .in iii)|ii n t.inl |)i ni \ \\ .iuliiu| .iti iii-.l i li i In »n 
.i,-hi(«vi» Its iio.ils. 1 n IIkiI I'liil, .1(1 I'xhMM.il cv.iiii.itoi shouKI he ("lutsrn wilh ( siir, lui tin- 
|)ri)fiissiorh)l i^oiUr iIxiIkm) [h'/sIh- <mii in.ikr lo .issistiix) I lie inshtutinii m s(i'Mi(|tluMiiii(| 
.KMdtMinc .111(1 .njfnimslrjl»\ ,)f<si:. 
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